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Player ranking can be used to determine the quality of the contributions of a player to a collaborative commu- 
nity. However, collaborative games with no explicit objectives do not support player ranking, as there is no 
metric to measure the quality of player contributions. An implicit objective of such communities is not being 
disruptive towards other players. In this paper, we propose a parameterizable approach for real-time player rank- 
ing in collaborative games with no expHcit objectives. Our method computes a ranking by applying a simple 
heuristic community quality function. We also demonstrate the capabilities of our approach by applying several 
parameterizations of it to a case study and comparing the obtained results. 
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I. INTRODUCTION 

Player ranking in collaborative games allows determining 
whether a player is contributing to the community or harming 
it. Player rankings are used to give rewards fair players with 
perks and to punish disruptive players. These perks or penal- 
ties alter the reach of the player's actions so their influence 
on the community is proportional to how good the player's 
contributions are. 

When the game has clear shared objectives, it is easy to de- 
termine how much a player is contributing to the community, 
just by measuring how much the player's actions contribute 
to the objective completion. This has been widely studied 

Hiii. 

However, when the game has no clear objectives, no met- 
ric exists to measure player contribution quality. Indeed, each 
player may have a different personal motivation to achieve dif- 
ferent self-imposed goals [4], and player actions can be con- 
sidered fair or disruptive towards the community depending 
on whether they respect or damage other player contributions. 
In these cases, there is a very abstract and subjective shared 
implicit objective that could be described as building a fair 
and not disruptive player community. It should be noted that 
fair players benefit from their behavior, as it is more likely 
that other players act fair towards them. Furthermore, a com- 
munity of disruptive players seems to repel fair players and 
the community quality has an intuitive tendency to gradually 
drop off. Contrarily, a community of fair players lures new 
fair players, which lead, in turn, to an increase of the commu- 
nity quality. 

As a player ranking can be used to fairly assign perks and 
penalties, and such alterations raise the quality of a commu- 
nity, a player ranking approach based on community quality 
closes a feedback loop and allows collaborative communities 
to self-control and gradually increase quality. 

In this paper, we propose and compare a parameterizable 
approach for real-time player ranking in collaborative games 
with no explicit shared objectives that produces player rank- 
ings from the application of a simple, domain-specific heuris- 
tic function to measure the quality of the community. 

Section introduces real-world scenarios that can bene- 



fit from player ranking. Section |III] describes our approach 
to real-time player ranking in collaborative games with no ex- 
plicit objectives. SectionlTVlpresents. evaluates, and compares 
results obtained from applying different parameterizations of 
our approach to a case study. Section |V] exposes our conclu- 
sions and the future work that derives from our research. 



II. BACKGROUND 

We now proceed to introduce several cases of collabora- 
tive games with no explicit objectives. We also explain how a 
player ranking allows the implementation of mechanisms that 
improve these communities. 

Subsection jlLAj introduces a real case of collaborative 
game: Minecraft. Subsections III.BI and III. CI describe a dis- 
cussion forum and a recommendation site, respectively, and 
model them as collaborative games. Finally, Subsection III. D| 
presents the collaborative clustering game, an abstraction of 
collaborative games with no explicit objectives that we will 
use to demonstrate the validity of our approach throughout 
this work. 



A. Minecraft 

Minecraft is a 3D open world video game fl*] in which play- 
ers can collect resources pictured as textured cubes and ar- 
range them to build contraptions. 

Although Minecraft has no explicit objective, the fact that 
it supports multiplayer mode makes it a collaborative game: 
players may help each other gathering resources and building 
complex constructions. However, disruptive players may join 
an ongoing game play and deliberately destroy other player 
artifacts. Administrators can ban players but, in order to effec- 
tively do so, they should have to keep an eye on every single 
player in the community. 

Player rankings in Minecraft would highlight disruptive 
players and help distinguish them from fair players that have 
accidentally caused slight damages to other player contrap- 
tions. It should be noted that such a ranking would allow the 
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administrators to focus their attention on the potentially dis- 
ruptive players. 



B. A Discussion Forum 

A discussion forum is a site where people can hold conver- 
sations in the form of posted messages. Users taking part in 
them ask and answer questions to other users. 

Forums have no explicit objectives. However, they have 
the implicit objective of putting together a reliable community 
that provides reliable answers to user inquiries. 

Perks in forums involve increasing the visibility of fair 
player messages, while penalizations often involve banning 
disruptive users to deter or prevent them from bothering oth - 
ers |9]. 

Player rankings in discussion forums would uncover dis- 
ruptive behaviors. This information can be exploited by mod- 
erators, which would only need to focus their efforts in watch- 
ing potentially disruptive users. 



C. A Recommendation Site 

A recommendation site seeks to predict user preferences 
by considering the user's item ratings and the complex social 
networks users themselves conform. 

Recommendation sites, as discussion forums, have no ex- 
plicit objectives. However, they have the implicit objective 
of training the system to provide good recommendations to 
users. 

Perks and penalizations in recommendation sites are often 
reflected as user reputation that determine how much their rat- 
ings are taken into account 

Player rankings in recommendation sites would point out 
possibly troublesome players who only seek to destabilize the 
rating system, for example by incorrectly rating items. Such a 
player ranking can be used to alter player reputations and, in 
turn, the value of such unfair player ratings. 



D. The Collaborative Clustering Game 

As part of our research, we have developed the collabora- 
tive clustering game abstraction as a case study. 

The collaborative clustering game is a multi-player real- 
time collaborative video game. In it, all the players share a 
board with the same number of white, light gray, dark gray 
and black dots. Players can drag and drop any dot and the 
movement is mirrored in real time on every player screen. A 
dot that is being dragged cannot be moved by another player 
until dropped. An example of collaborative clustering game 
board is shown in Figure [T] 

We assume that players do not get points from their actions 
in this game (i.e. there is no explicit objective), but that they 
somehow benefit from having all the dots of the same color 
clustered together and apart from other color dots. For exam- 
ple, assume that users have the task to cluster any new dots 




Figure 1 A collaborative clustering game board 



that appear in the board, and the fact clusters are clearly dis- 
tinguished benefits players in fulfilling their task. 

It should be noted that this is a pseudo-game, an abstraction 
of game models similar to those for a discussion forum or a 
recommendation site: users interact with the community con- 
tents in real time, their actions modify the community quality, 
and a high quality community benefits the user. Also, there 
could be fair or disruptive players. 

Measuring the quality of a collaborative clustering game is 
trivial and, therefore, we will use it throughout this paper to 
objectively evaluate the player ranking approach we present 
in the next section. 



III. PLAYER RANKING BASED ON COMMUNITY QUALITY 

We proceed to explain our parameterizable approach for 
player ranking in collaborative games with no explicit objec- 
tives using a heuristic community quality function. 

Subsection llll.Al describes our expression for player contri- 
bution quality rating. Subsection llll.Bl exposes an asymptotic 
analysis of our algorithm. Subsection Illl.Cl explains our sys- 
tem training and evaluation capabilities. Finally, Subsections 
IIII.DI to rill.GI present examples of applications of our system 
to the games introduced in Section HH 



A. Contribution Quality Rating 

Although obviously there does not exist an exact metric 
for the quality of a community, there can be defined heuris- 
tic functions that approximate the community quality value. 
Several examples of such heuristics will be studied further in 
this Section. 

The contribution quality rating or CQR for a player can be 
estimated from the effect the player's actions have on the com- 
munity quality. Whenever a player's action causes the com- 
munity quality to increase (resp. decrease), the player's CQR 
has to increase (resp. decreases). 

While the player CQRs are not relevant on their own, a 
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player ranking based on CQRs is a good measure of the qual- 
ity of the contributions of each player relative to others in the 
community. Automatic preventive actions such as penaliza- 
tions or alarms can be triggered when a player's CQR meets 
criteria such as exceeding a threshold that is either absolute or 
relative to the distribution of the community CQRs. 

Communities consists of a set of community quality do- 
mains. Each community quality domain can be assigned a 
different heuristic community quality function and can repre- 
sent different partitions of the community. For example, it is 
possible to establish a correspondence between different de- 
mographic groups in a recommendation site and community 
quality domains, and it is possible to define measures of differ- 
ent phenomena such as use of capital letters or swear words in 
a discussion forum as community quality domains. It should 
be noted that these domains may even overlap, that is, a single 
player action may affect several of them. 

Each community quality domain Ci in a community C is 
to be assigned a heuristic function Q{-) that approximates its 
quality value. The change caused to the quality of a commu- 
nity C by a player when he performs an action a is denom- 
inated delta value of the action and can be formalized as a 
function A(C, a). This function is the sum of the changes in 
the quality of all the community quality domains as caused by 
the player action: 

|C| 

A(C,a) =^g(a(C),)-Q(Q) (1) 

In the equation above, the effect of a player action a on a 
community has been formalized as a function a(- ), that ap- 
plies the action to a community and returns, as a result of the 
action, the resulting community. 

As a first approach, given A, the list of the 
n delta values A = {A(C, ai), A(ai (C), 02), 

A(a„_i(...ai(C)))), a„)} corresponding to a sequence of 
n player actions, the CQR of a player is defined as: 

n 

CQi?(A) = 5] A. (2) 

i=l 

This approach clearly has a major flaw: it is not readily re- 
sponsive to changes in players' behavior For example, a fair 
player may turn disruptive due to an argument with other play- 
ers. It would take a long time until the recent disruptive action 
deltas surpass the past fair actions and, therefore, when using 
this expression it would take a long time to tag these play- 
ers as disruptive. Intuitively, it is necessary to add some kind 
of temporal constraint to the expression. This way, a player 
that starts damaging the community can be quickly tagged as 
disruptive. 

In order to solve this flaw, we propose a parameterization 
of our previous CQR expression, as follows: 



When using this approach, only the latest T deltas are con- 
sidered in the calculation of a player's CQR. Now, when a 
player changes its behavior, it will only take up to T/2 ac- 
tions on average to notice that the behavior has changed. The 
proposal in (|2]i is, indeed, a particular case of this approach 
when T ~ 00. 

Nevertheless, this new approach has a new drawback. Se- 
ries of low value positive actions may force the expression to 
ignore high value actions. 

In order to solve this drawback, define fx, a filter that re- 
moves the deltas whose absolute value is less than a; in a list, 
and we propose a new parameterization of our previous CQR 
expression, as follows: 



When using this approach, only the latest T deltas whose 
absolute value is greater than or equal to x are considered in 
the calculation of a player's CQR. Insignificant actions will 
now be ignored and they will not mask relevant action deltas. 
The proposal in (O is, in turn, an instance of this more generic 
approach, with x = 0. 

It should be noted that this filter brings back some respon- 
siveness issues to our approach, as an average of T/2 actions 
are needed to detect a change in behavior 

In order to solve this problem, we define g^, another filter 
that, whenever the last k elements of the already filtered delta 
list are all positive (resp. negative), all the negative (resp. pos- 
itive) values in the list are made into zeros. We then propose 
a final parameterization of our previous CQR expression, as 
follows: 



CQRtM^) = 9k{MA)) (5) 

i=n-T+l 

This new filter emulates the effect of the differential correc- 
tion in a PID controller and, indeed, raises the responsiveness 
of the expression so that, apart from the T/2 average actions 
needed to detect a change in behavior, a maximum of k ac- 
tions is enough to detect it. The proposal in Equation |4] is a 
particular case of this more generic approach, when k = T. 



B. Asymptotic Analysis 

The memory requirements of an efficient implementation 
of the CQR expression are: 

{P, if T = 00, k^T 

(fc + 2)-p, ifT- fc<r 
T-p, ifr<oo,fc = r 
(T + 2)-p, ifr<oo, fc<r 



mem 

n 

CQRt{A)= (3) 

i=n~T+l 



being P the number of players. 
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As k is always less than or equal to T, in the worst case, 
mem{T, k,P) = (T + 2) • P. T can be considered a constant, 
therefore mem{T, k, P) is 0{P). 

The processing time requirements of an efficient implemen- 
tation of the CQR expression are: 

time{T,k,A) = l^^^^^^^ll = l (7) 

being A the total number of actions performed by players. 

In the worst case, time{T, fc, A) = {k + 1) ■ A. k can be 
considered a constant, therefore time{T, k, A) is 0{A). 

These limits show that the algorithm has a very small mem- 
ory fingerprint and is not processing-intensive. Our approach 
can be appUed in real time and it can be implemented in any 
existing system. 



E. Application to a Discussion Forum 

Let C be a discussion forum community, then the commu- 
nity quality value can be defined as: 

Plength 

p^C ^capital-chars ^ 

„, ^, "Kforbidden-words 

Q{C) = '^^^^ (9) 

The proposed quality function rewards long posts versus 
short posts. It also penalizes posts with high percentages of 
capital letters and forbidden words. 

The definition of such a function is enough for our system 
to produce real-time forum users rankings. These rankings 
can be used to determine which users are disruptive and draw 
the moderator attention on them. 



C. Training and Evaluation Capabilities 

Given the low resource requirements of the system, several 
simultaneous parameterizations of the algorithm can be run 
online on the same game play data. Feedback such as penal- 
ties imposed to players by moderators or administrators al- 
lows performing automated learning by evaluating and adjust- 
ing the parameterizations and community quality functions in 
order to optimize the player ranking accuracy. 

More interestingly, widely used optimization algorithms 
can be applied to parameter and function training by apply- 
ing the system to extensive pre-recorded game play logs and 
evaluating its performance. 



D. Application to IVIinecraft 

Let C be a Minecraft community, then the community qual- 
ity value can be defined as: 



Q(C') — ^ ^ ^rarity 



collcctcdjiatural | 



|^collectcd_placcd_other_user | 



(8) 



This heuristic rewards players who collect more natural 
blocks than blocks placed by other players, and it penalizes 
players who collect blocks that were placed by other players 
and that, therefore, may be incurring of damage to artifacts. It 
should be noted that blocks removed by the same player that 
placed them do not alter the community quality. 

Block rarity values are used as weights, as less common 
blocks that are placed by players have a higher chance of con- 
forming a complex valuable player contraption. 

Such a simple function is enough for our approaches to pro- 
duce real-time Minecraft player rankings that highlight dis- 
ruptive players who, at some moment, have started altering 
others contraptions. 

It should be noted that this is a sample heuristic function 
and that it can obviously be greatly improved. One of the main 
advantages of our proposal is that a change in the heuristic 
function is enough to alter the criteria implicit in the player 
ranking. 



F. Application to a Recommendation Site 

Let C be a recommendation site community, then the com- 
munity quaUty value can be defined in function of the vari- 
ances of each item ratings as: 



Q{C) 



E 



\c\ 



(10) 



Variances increases whenever outlying ratings are assigned 
to an item, therefore the proposed quaUty function reward new 
ratings that are close to the average rating for the item. 

It should be noted that item ratings are subjective and dis- 
tinct user sets may provide different consistent sets of ratings 
for items. In this case, users can be clustered using by consid- 
ering the sets of user ratings they provided, so that users with 
the same Ukes pertain to the same sub-community. 

The definition of such a simple function is enough for 
our technique to produce real-time recommendation site user 
rankings. These rankings can be used to determine user repu- 
tations, which can, in turn, alter the weights used for the cal- 
culation of item ratings. 



G. Application to the Collaborative Clustering Game 

Let C be a collaborative clustering game. We defined a 
community quality function that reflects how close each color 
dot is to the same color dot centroid and how far it is from 
dots of different colors, as follows: 



QiC) = -j:cec 



+ E 



cl,c2eC,cl#c2 ■ 



^dec dist{d,centroid{c)) 



gel ^d2ec2 



dist{dl,d2) 



(11) 



|cl|.|c2| 



being centroid a function that retums the centroid of a color 
dots, and dist a function that retums the euclidean distance 
between two positions. 
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Interestingly, the fact that the community quaUty function 
for this game is not heuristic but exact allows performing a 
quantitative comparison of the obtained results. 

In the next section, we present, evaluate, and compare 
the rankings obtained from four parameterizations of our ap- 
proach being applied to a game play of the collaborative clus- 
tering game. 

IV. APPROACH EVALUATION 

In order to evaluate the proposed approach for player rank- 
ing in collaborative games with no explicit objectives, we have 
run a 20-player play of the collaborative clustering game and 
we have collected and analyzed the game play data with the 
heuristic community quality function in Equation [TT] 

Four classes of 5 players each have been asked to follow 
different behaviors during a sequence of 20 actions: 

• The F class are fair players. 

• The / class were disruptive players who turned fair at 
some point. 

• The d class were fair players who turned disruptive at 
some point. 

• Finally, the D class are disruptive players. 

While the F and D classes test the overall system perfor- 
mance and accuracy, the / and d classes test the system re- 
sponsiveness capabilities. 

We expected to obtain, at the end of the 20-action series, 
a ranking in which both the F and the / player classes were 
located in the upper half of the ranking and both the d and the 
D player classes were located in the lower half of the ranking. 

Although it seems intuitive that an ideal ranking would list 
the F player class in the interquartile 1, the / player class in 
the interquartile 2 (as they are fair, but not as fair as the F class 
players), the d player class in the interquartile 3 (as they are 
disruptive, but not as disruptive as the D class players), and 
the D player class in the interquartile 4, it should be noted 
that the reason for the ranking is to determine whether players 
are being disruptive or fair at the current time, that is, at the 
end of the 20-action series. However, in the evaluation of our 
approaches we will give a slightly greater value to the fact that 
the player ranking makes a correct distinction between the F 
and the / player classes, or between the D and the d player 
classes. 



A. Approach Parameterizations 

We are going to evaluate the following four parameteriza- 
tions of our contribution quality rating approach: 

• CQRoo.0,00 returns the sum of all the deltas of a 
player's actions. This approach gives relevance to 
the behavior of players through time, and may be not 
enough responsive and accurate if the player's behavior 
changes. 



• CQi?8,o.8 returns the sum of the latest 8 deltas of a 
player's actions. This approach should be more respon- 
sive than CQRoofi.oo, as in not more than 4 actions in 
average it should be able to detect changes the behavior 
of players. 

• C(5i?8,io,8 returns the sum of the latest 8 deltas of a 
player's actions whose absolute value is greater than or 
equal to 10. This approach might produce results that 
are intermediate between CQRoo,o.oo and CQRs.o^s, 
as it takes into consideration more deltas, but, for that 
same reason, is less responsive. 

• Finally, CQRs,io,4 returns the sum of the latest 8 deltas 
of a player's actions whose absolute value is greater 
than or equal to 10, however if the latest 4 are all pos- 
itive (resp. negative), all the negative (resp. positive) 
deltas are ignored. This approach should produce re- 
sults that are better than CQRs^.s, as it takes into 
consideration more delta actions, but also better than 
CQRs,io,s and CQRoo.o.oo, as it has a high respon- 
siveness to behavior changes. 

We now proceed to show the obtained results. 

B. Results and Discussion 

Table U shows the delta values associated to each of the 20 
actions of the 20 players. Positive values reflect fair actions, 
negative values reflect negative actions. Greater absolute val- 
ues reflect actions with a greater impact in the community. 
Tablellllshows the four rankings corresponding to the four pa- 
rameterizations. 

From the analysis of Table |II] it can be observed that our 
predictions on the results were accurate: 

• CQRoofl.oo got many disruptive and fair players inter- 
mixed due to the fact that it considers all the deltas of 
player actions and therefore is not responsive toward 
changes in the behavior of players. 

• CQRs.o^s is highly responsive and has managed to clas- 
sify in the upper half of the ranking all the players who 
ended up acting fairly, and in the lower half of the rank- 
ing all the players who ended up acting disruptively. 
Some intermixing of the F and the / player classes and 
of the D and the d player classes can be observed, as 
this technique is not able to consider past action deltas. 

• CQRs.10.8^ in contrast, takes into account older action 
deltas by ignoring some of the most recent low value 
deltas. However, it loses responsiveness as a side effect 
of this, which causes a slight intermixing of the players 
classes in the ranking. 

• Finally, CQRs.iOA produces a correct ranking. This 
is due to the fact that the extra past action deltas that 
are considered is balanced with the extra responsiveness 
filter. 
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Table I Comparison of four parameterizations of oiir player ranking approach: List of the action deltas and the contribution quality ratings for 
20 players given 20 actions in the collaborative clustering game 
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-17 


-14 


-12 


-16 


+05 


+12 


-16 


-21 


+03 


+13 


-22 


+25 


-06 


-16 


+26 


-12 


-37 


-15 


-18 


-03 


-141 


-81 


-69 


-157 


D4 


-05 


-25 


-21 


+05 


+16 


-12 


-15 


-13 


+24 


-17 


-14 


+09 


-24 


-12 


-16 


+14 


-13 


+02 


-21 


-34 


-172 


-104 


-120 


-120 


D5 


-36 


+45 


-23 


-25 


-14 


-51 


+21 


+12 


-14 


-19 


-24 


-16 


-04 


-05 


+02 


+03 


-15 


+12 


-14 


-42 


-207 


-63 


-132 


-132 



CQR CQR CQR CQR 



Table 11 Rankings obtained from the application of the four parameterizations of our player ranking approach 



CQ-Roc,o,oo CQRgM,s CQRg.io^s CQRs, io,4 



rank 


id 


value 


rank 


id 


value 


rank 


id 


value 


rank 


id 


value 


1 


Fl 


300 


1 


Fl 


159 


1 


Fl 


178 


1 


fl 


188 


2 


F4 


289 


2 


12 


120 


2 


F4 


170 


2 


Fl 


178 


3 


d2 


177 


3 


f5 


92 


3 


F2 


93 


3 


F4 


170 


4 


F3 


133 


4 


F4 


69 


4 


f2 


91 


4 


f3 


144 


5 


d3 


124 


5 


fl 


66 


5 


F3 


55 


5 


F5 


125 


6 


dl 


99 


6 


F2 


64 


6 


f5 


46 


6 


F2 


93 


7 


d5 


98 


7 


f4 


41 


7 


f4 


30 


7 


f2 


91 


8 


F5 


59 


8 


f3 


40 


8 


F5 


27 


8 


f5 


88 


9 


F2 


38 


9 


F5 


31 


9 


d3 


21 


9 


F3 


55 


10 


fl 


9 


10 


F3 


27 


10 


fl 


20 


10 


f4 


30 


11 


t3 


5 


11 


d4 


-4 


11 


d2 


-3 


11 


d3 


21 


12 


f4 


-7 


12 


Dl 


-36 


12 


13 


-15 


12 


d4 


-59 


13 


a 


-46 


13 


d2 


-49 


13 


d5 


-33 


13 


d2 


-69 


14 


d4 


-42 


14 


d3 


-50 


14 


d4 


-59 


14 


D2 


-83 


15 


f5 


-110 


15 


D2 


-58 


15 


D3 


-69 


15 


D4 


-120 


16 


D3 


-141 


16 


D5 


-63 


16 


D2 


-83 


16 


dl 


-130 


17 


D2 


-166 


17 


d5 


-63 


17 


Dl 


-94 


17 


D5 


-132 


18 


D4 


-172 


18 


D3 


-81 


18 


D4 


-120 


18 


Dl 


-137 


19 


Dl 


-177 


19 


D4 


-104 


19 


dl 


-130 


19 


d5 


-147 


20 


D5 


-207 


20 


dl 


-132 


20 


D5 


-132 


20 


D3 


-157 
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Table III Player class to interquartile correspondence values for 
ranking evaluation 





Interquartile 


class 


I II III IV 


F 


6 4 -10 -25 


f 


4 6-4 -10 


d 


-10 -4 6 4 


D 


-25 -10 4 6 



Table IV Quantitative comparison of the four parameterizations of 
the approach using the results in Table |ll] and the correspondence 
values in Table IIIII 



parameterization 


value 


CQ-Roo,0,oo 


34 




100 


CQRs,io,s 


92 


CQRs,io,4 


104 



In order to quantitatively compare the results procuded by 
the different parameterization of our approach, we have as- 
signed values to the correspondence between the ranking in- 
terquartiles and the player classes in the ranking. Table |III] 
shows these correspondence values. 

Table llVl presents the quantitative comparison on the corre- 
spondence between ranking interquartiles and player classes 
for the four approaches using the correspondence values in 
Table |lll] As it can be observed in this table, CQi?oo,o.oo 
has the lowest correspondence, CQRs.o^s greatly improves 
it, CQ Rs,io,s offers a slight decrease in accuracy, and 
CQRs.ioA improves it back again and over C(5i?8,o,8- This, 
again, reflects our predictions. 

Overall, the rankings performed by the CQi?8,o.8 and 
C(3i?8,io,4 parameterizations of our approach are very good 
approximations of the expected ranking and similar parame- 
terizations can be used to help in the management of collabo- 
rative communities and games. 

In the next section, we present our conclusions and the fu- 
ture work that derives from our research. 



V. CONCLUSIONS AND FUTURE WORK 

Player ranking in collaborative games allows determining 
whether a player is contributing to a community or harming it. 
Player rankings are used in games or communities to reward 
contributing players with perks or to punish disruptive players. 
These perks or penalizations usually modulate the impact of 
the player's actions in the community. 

When the game has clear shared objectives, it is easy to de- 



termine how much a player is contributing to the community, 
just by measuring how much the player's actions contribute to 
the objectives completion. 

We have proposed a parameteiizable approach for real-time 
player ranking in collaborative games with no explicit ob- 
jectives that produce player rankings from the application of 
heuristic community quality functions. 

Our approach has been successfully tested with a game play 
of the collaborative clustering game. In this experiment, the 
players were ranked coiTectly according to their intended be- 
havior, which demonstrates that our approach provides good 
approximations to player rankings. 

In the future, we plan to research on automated learning 
of community quality functions and contribution quality rat- 
ing expression parameters by analyzing complex tagged game 
play logs, in order to automatically produce ranking mecha- 
nisms for collaborative games and communities. 
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